Statistical Tests for Person Misfit in Computerized Adaptive Testing

DOCUMENT RESUME TM 028 873 Glas, Cees A. W.; Meijer, Rob R.; van Krimpen-Stoop, Edith M. L. A. Statistical Tests for Person Misfit in Computerized Adaptive Testing. Research Report 98-01. Twente Univ., Enschede (Netherlands). Faculty of Educational Science and Technology. 1998-00-00 28p. Faculty of Educational Science and Technology, University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands. Reports Evaluative (142) MF01/PCO2 Plus Postage. *Adaptive Testing; *Computer Assisted Testing; Foreign Countries; *Responses; *Testing Problems Local Independence (Tests); *Person Fit Measures; Power (Statistics); Two Parameter Model Recently, several person-fit statistics have been proposed to detect nonfitting response patterns. This study is designed to generalize an approach followed by Klauer (1995) to an adaptive testing system using the two-parameter logistic model (2PL) as a null model. The approach developed by Klauer is described, and some difficulties in generalizing it to a computerized adaptive testing model are explored. Alternative approaches are presented, and the results of a power study and the consequences for person-fit measurement in adaptive testing situations are discussed. The first part of the simulation concerns the ability to ignore the process that causes missing data and the impact of the fact that data in adaptive testing are not observed at random. Then the power of the proposed three tests is studied. Results suggest that tests against local independence in the 2PL have little power, but that the power for testing against nonvariant abilities is relatively larger but still low. (Contains 4 tables and 18 references.) (SLD) ******************************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ******************************************************************************** Co) Co NCO 2I0 Statistical Tests for Person Misfit in Computerized Adaptive Testing Cees A.W. Glas Rob R. Meijer Edith M.L.A. van Krimpen-Stoop PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY 4,e t't 55 efl TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) Research Report 98-01 U.S. DEPARTMENT OF EDUCATION Office ot Educational Research and Improvement EDUCATIONAL RESOURCES INFORMATION CENTER (EIC) ...ffri";:is document has been R reproduced as received from the person or organization originating it. Minor changes have been made to improve reproduction quality. Points of view or opinions stated in this document do not necessarily represent official OERI position or policy. faculty of EDUCATIONAL SCIENCE AND TECHNOLOGY Department o Educational Measurement and Data Analysis 0 University of Twente Statistical Tests for Person Misfit in Computerized Adaptive Testing Cees A. W. Glas Rob R. Meijer